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BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of 
the original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 

• BLACK BORDERS 

• TEXT CUT OFF AT TOP, BOTTOM OR SIDES 

• FADED TEXT 

• ILLEGIBLE TEXT 

• SKEWED/SLANTED IMAGES 

• COLORED PHOTOS 

• BLACK OR VERY BLACK AND WHITE DARK PHOTOS 

• GRAY SCALE DOCUMENTS 



IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 



1 



Multimedia Interface 



Gesture 
Generation 



kiosk 





Figure 1: Gesture Recognition System, 
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Figure 2: Gesture Recognition System Flow 

Chart. 
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Figure 3: Signal Flow Diagram of the Gesture 

Recognition System. 
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Figure 4: Example gestures, showed 
in two dimensions. 
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Figure 5: Three Example 
Gestures. 
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Figure 6: An Example 24 Gesture Lexicon. 



Figure 7: Slow Down Gesture 




Figure 8: Prepare to Move Gesture 



Figure 9: Attention Gesture. 



Figure 10: Stop Gesture 




Figure 1 1 : Right or Left Turn Gestures. 




Figure 13: Freeze Gesture 
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A one dimension oscillating 
x-line human gesture performed 
in two dimensional space. 
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A time history of the x-line 
human created gesture. 
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A two dimensional phase 
space trajectory of the 
human created x-line gesture. 



Figure 14: Plots of a Human Created One 
Dimensional X-Line Oscillating Motion. 
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Figure 15: Possible Lines Associated with 

x(t,p)=p0+p1t and Their Equivalent 
Representation in the p Parameter Space. 
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Figure 16: Parameter Fitting: We Require a 
Rule for q to Bring the Error to Zero. 
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Figure 17: Plots of Different (xi,yi) Data 
Points that Result in a Different Best Fitting q 

Line. 
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Figure 18: The Recursive Linear Least 
Squares Method for Updating q with Each 
Additional (xi,yi) Data Point. 
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Figure 19: An Exaggerated Representation 
of the Residual Error Measurement. 
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Figure 20: An Algorithm for Determining the 
Specific Gesture Model. 
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Figure 21 : The Worst Case Residual Ratios 
for Each Gesture Model. The Lower the 
Ratio, the Better the Model. 
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A plot of the above y- 
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Figure 22: Two Perpendicular Oscillatory 
Line Motions Combined into a Circular 



Gesture 



Figure 23: Bounding Box Around Hand 




Figure 24: Descriptions from Bounding Box 
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Figure 25: The Example Gestures. 





Figure 26: Schematic of the Hand Tracking 

System Hardware. 
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Figure 27: Flowchart of the CTS 




Figure 28: Graphical User Interface of the 

CTS. 
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Figure 29: Target Center from Difference 

Image. 
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Figure 30: Color Matching Technique. 
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Figure 31: Identification Module. 
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Figure 32: Simplified Diagram of the 
Dynamic Gesture Prediction Module. 



